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METHOD FOR DISPLAY WITH COLOUR FIDELITY OF IMAGES TRANSMITTED IN A NETWORK 

5 

Related Applications 

This application is a continuation-in-part of copending 
Unites States patient application serial no. 09/422,215 filed 
10/19/99 and claims the priority of provisional applications 
10 serial no. 60/108,444 filed 11/13/98, serial no. 60/108,442 
filed 11/13/93, and serial no. 60/108,229 filed 11/13/98, 
serial no. 60/103,231, filed 11/13/98 and serial no. 
60/108,228 filed 11/13/93. 

15 Background of the Invention 

1, Field of the Invention; 

This invenricr. relates to image display over a network, 
and more specifically to improved image color display over a 
network. 

20 

Brief Description of the Drawings 

Fig. 1 is a stylized block diagram of a network according to 
the present invention. 

25 Fig. 2 is a flow chart of the process of the present 
invention. 



Fig. 3A is block diagram of a network according zo the present 
invention. 
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Fig. 33 is a flew chart of the process of the present 
invention. 

Fig. 4 is block diagram of a network according to the present 
invention. 

Fig. 5A is a "flew chart of the process of the present 
invention . 

Fig. 53 is block diagram of a network according to the present 
invention. 

Fig. 6A is a screen view of a web page according to the 
present invention. 

Fig. 63 is block diagram of an HTML file according to the 
present invention. 

Fig. 7 is a block diagram of the process steps of the present 
invention . 

Fig. 3 is a block diagram o 
invention . 



f the process steps of the present 



Fig. 9 A is an enlarged view of an indicator according to the 
present invention . 

Fig. 9B is an enlarged view of an alternate indicator 
according to the present invention. 

Fig. 10 is a block diagram of an alternate embodiment 
according to the present invention. 

Fig. 11 is a block diagram of an alternate network according 
to the present invention. 
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' Fig. 12 is graph of a parameter space according to the present 

invention . 

Fig. 13 is a oarar.e-er distribution curve according to the 
present invention. 
5 Fig. -4 is a graph of display transfer functions according to 
che presenc invention . 

Fig. 15 is a block diagram of a first alternate process 
according to the present invention. 

Fig. 16 is a block diagram of a second alternate process 
10 according to the present invention. 

Fig. 17 is a de-ailed block diagram of a network according to 
the present invention. 

Fig. 13 is a detailed transform curve according to the present 
invention. 

Fig. 19 is a derailed diagram of a display screen according to 
the present invenzicr. . 

FIG. 20 is a block diagram of a computer and display including 
test pattern in accordance with the present invention. 

FIG. 21 is a detailed depiction of the test pattern for 
20 determining -.he optiaal viewing angle of the display shown in 
FIG. 1. 

FIG. 22 is a graph of a tone reproduction curve for a flat 
panel display. 

FIG. 23 is a depiction of a test pattern for determining the 
25 optimal viewing ancle of a display using a plurality of 
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, • r ^» r ce a « alternative entbodiment of the 

backgrounds in e.c~c_ — 

invention . 

F t G 24 is a depiction of a test pattern for determining the 
optimal viewing angle of a display by sequentially displaying 
the test patterns in succession in accordance with another 
alternative embodiment of the invention. 

pr G . 25 is a flew chart illustrating a method for determining 
the optimal viewing angle of a display in accordance with the 
preferred embodiment of the invention. 

FIG. 26 is a flow chart illustrating a method for determining 
the optimal viewing angle of a display in accordance with an 
alternative embodiment of the invention. 

F T G 27 is a flow chart illustrating a method for calibrating 
and' characterizing an image capture device via a feedback loop 
from a known calibrated display in accordance with the 
preferred embedment of the present invention. 

FIG. 23 is a functional block diagram of a calibration system 
for image capturing devices. 



The features and advantages of this invention will become 
apparent from the detailed description and accompanying 
figures that follow. In the figures and description, numerals 
indicate the various features of the invention, like numerals 
referring to like features throughout both the drawings and 
the description. 
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nailed Description of the P referred Embodiment ( sj 

„ - .. t<- i svs-em 10 according to the 

present invention provides color images from network servers 
to users enhanced when possible with user^ecif icj:olo&, 
correction information to provide high fidelity color images 
to the users. In particular, ir. accordance with a preferred 
embodiment cf the present invention, color server 20 may 
provide coicr catalog cages for clothing, or other products to 
a potential buyer, such as user 12, adjusted to provide high 
fidelity color images in accordance with the color display 
characteristics of display 22. 

In general, system 10 may include one or more network 
servers and one or more users . Network servers may include 
color server 20, commercial server 13, and server 76. Users 
may include users 12, 14 and 15. interconnected to network 
servers using network 13 . Network nodes such as color server 
20 may serve as a user or client for some purposes and a 
server for ethers. System 10 dees not require a static 
server, constantly functioning as a server, in ail 
embodiments . 

Network 13 tray be any type of network such as a LAN, 
intranet or an internet such as the World Wide Web (WWW) . 
Network 13 may also utilize any type of appropriate network 
protocol, such as HTTP as used on the World Wide Web. Color 
server 20 may be used to host color correctable images 50 to 
be made available to users of commercial or other network 
sites. 

User 12 may be any conventional network client device and 
rrav include one or more electronic devices 24, conventionally 
a personal computer or workstation, and one or more display 
devices 22. conventionally a c?.T or LCD display monitor. User 
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12 may also include remote storage 26 and or local storage 28 
within electronic device 24. P.er.cte storage- 25 may also be 
available tc electronic device 24 through network 13. User 12 
may also include one :r more out?u: devices 30 which may be 
any type of printer, recorder or plotter. User 12 may also 
include one or more input devices 3 2 which may be any type of 
scanner, reader, isaga capture device or other data transfer 
device . 

Delivery of accurate images according to the present 
invention begins with image request 54 sent to commercial 
server 13 for the display of an image on monitor 22. Image 
request 54 may originate with user 12 or any network device 
such as server 75. Image request 54 may be an individual 
request for a specific image, graphic, drawing, rendering or 
similar data file or it may be par- of a larger data request 
such as a web page request. Commercial server 18 may respond 
to image request 54 by then inquiring o f the sourrP of the 
image request to determine if displ ay ral Oration or, 
characterization f — ^«.~-, y ^ available^ 

If disoiav calibration or characterization data 33 is 
available to commercial server 13, a color corrected version 
of image 52 may be provided to user 12 in accordance with data 
33. Thus, image 52 as then displayed on display 22 may be a 
more accurate colcr representation of a reference or author 
image, image 55 than may otherwise be achieved. Concurrent^ 
with delivery cf color corrected images, display 22 may 
present a visual of.her indicator 53, indicating that the^ 
image or images being viewed ar e color corrpr.r. e d and accurate.. 
Indicator 53, cr a variation thereof, may also be used to _ 
indicate when images are not color correc tgd.and or provide 
other information t: user 12. An online shopper or other user 
mav have increased confidence to make purchases, as a result 
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20 



30 
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- ■ rfirr ^aae ^ over network 13, knowing the color of 
on viewing -~.age — 

«-»c- 52 as actually viewed is accurate. 

• „ n - ^a-acte-za^ion data 38 -S not 
I-- disolay calicraticn or ...a,acue..za.. 0 

/ ^-^a" serve- IS. user 12 may be invited to 
available to cotrr.e-c.a_ serve. 

c3 ^at- or characterize display 22 through network 13 with 
or wlchouc rearing Plug-ins or downlo ads. Without display 
„ a i Nation or characterization, imaged may appear 
^7,_ ar -, y co users 12, 14 and 1c because of different 

. or -- .-d-o cards, monitor settings and a range 
operating syscer.-, v_c_o caw 

of other factors. 

according co the present invention, process 131 as 

^ u i , -*v >e a one-time orocess, involving images 
discussed below rr.ay a one . 

52 .„ „d nine user interactions that .ay be mouse cli ck. , *ey 
o^esses, screen contacts or other interactive inputs to 
; ie c~or.ic device 24. Process 131 may delude other 

\ . . ons or -~~<cues to characterize a display system o- 

combinations or ~ec i aca - 1 , r 

. or> data. Process 131 may generally 

„ a „_..^ e other Derscr.a.-zau.or. u&_._ 

" *~7~ . ^ 2 T ,-^ 3 to complete, some circumstances may 

. comoletion of process 131, user .2 

require more time, a wul r 

im=c_ 3 without further setup. 
w receive color corrected imag-- w-«.o ^ 

„, M . h - hat refer to color correction snoulc 
Discussions thrcugncu- _nac re.e- ^ 

a11 .. - 0 a r- av scale correction, a 

be understood to apply equally -o g-a/ 

cha-acterizable and correctable network system according 
-present invention he used to. control deUvery^ 

Insure the a_oir«cyj >^^ 

Data Block Sharing 

• „ a -r a -i -o F<c 1, f^l-l bration or 
Referring aga.n -o r.y. _ 

, -i a he made available across 

... „ e - wo ^ -chains for co nvenient use to correct anc 

^ ■ acrQ ; 3 ae cwork 13 . Some network 

distribute images o- * z 
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protocols such as the HTTP protocol .used on Che WWW are able 
zo store da --a block s cr. user 12 or other network devices. 
Data block 34 may include many different: types of information 
including, user preferences and user hardware characteristics. 
3 conventional techniques providing client-resident data block 
s-c-ace are often referred to as providing "Cookies" . 

Cookie 3 5 may include one or more blocks of information 
oassed fro* a server and stored on a user, often as a result 
of rhe collection of chat information by the server from the 
10 user. Cookie 36 may then be used to provide, or retrieve, 
information from a user to a server. For example, user 12 
in formation concerning domain 77 may be passed from server_76 _ 
zo user 12 and stored or. user 12 as cookie 66-_ Subsequent 
' connection of user 12 to server 7 5 would prompt server '76 to 
15 request cookie 56 tc remind server 7 6 of information about 
-se- " 2 . This technique is conventionally used to provide 
personalized settings or information specific to user 12 on 
server 7 5 without requiring server 7 5 to store the data 
; f ation for all its users. For security purposes, 
20 conventional cookies are , designed so that they cannot be 

shared across multi ple domains. Conventional cookies may even 
be limit ed to URL ranges within a domain^ as is the case with 
the KTT? protocol. In a conventional network, a server in a_ 
first do main cannot access cookies stored for ^ano ther domain. 
25 Conventional cookies may not therefor be useful for 

providing display characterization and or calibration 
"information about a user to a server unless the cookies are 
specific to that server, that is, unless the server has placed 
the cockles or. the user. In accordance with the present 
3C invention however, various techniques of server and user 
-edirecticn -ay he used to achieve results equivalent to 
sharing cookies across domains. 
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?or example, if user 12 initiates request 6C to server 
75, server 7 5 may request data block 34 from user 12 to 
process request SC. 3ata block 34 may include personal, 
preference, calibration and or characterization information 
5 related to user 12. Data block 34 may also include an index 
to database 46 permitting information 45 to be retrieved from 
database 45. 

Referring .now tc Fig. 2, a method of sharing data blocks 
according to a first embodiment of the present invention 
10 begins at step 90 with request 54 from a user 12. According 
to the present invention, users 12, 14 and 15 may exist in one 
of three conditions. Standard condition 89S, in which no 
characterization and or calibration has been performed, 
Correction Enabled condition 89C, in which characterization 
15 and or calibration has been performed according to the present 
invention, Modified condition 89M, in which characterization 
and or calibration has been performed not according to the 
present invention. 

At step 91, agent 41 checks user 12 for a cookie 66. 
2Q At step 92 agent 41 determines if a cookie has been 

received. If no cook- a is recei ved, user 1 2 is bounced to 
color server 20 at step 93 . Bouncing may be accomplished 
using Java script or it may be accomplished using HTTP 
redirect. A currently preferred embodiment of the present 
25 invention uses Java script. 

If agent 41 receives cookie 65 from user 12, agent 41 and 
commercial server 13 have enough information to provide user 
12 with color corrected information at step 99A as requested 
in image recruas" z 1 . 
30 At step 94 colcr server 20 checks user 12 for a domain 15 

cookie. If no dcm a-r. 13 cookie is present , user 12 is given 
unique identifier ID and is bounced to "color server 20_ at step 
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95. The existence cf unique identifier ID signifies to agent 
41 chat user 12 is r.o: characterized and or calib rated, and 
thac corrected images may not be prepared for user 12 using 
existing inf ormacicr. . 

Ac step 95, if color server 20 detects a domain 15 cookie 
65A in user 12, user 12 is bounced to commercial server 18 
along with disciay calibration or characterization data 38. 

Ac step 97 agenc 41 drops cookie 66C to user 12. Agent 
41 uses the concer.es cf cookie 66c to provide a corrected 
image 52 to user 12 at step 98. 

Referring again to Fig. 2, a method of sharing data 
blocks according co a se cond embodiment of the present 
invention begins a; seep 90 with request 54 from a user 12. 

At steo 91, agenc 41 checks user 12 for a cookie 65. 

At step 92 agent 41 determines if a cookie has been 
received. If no, user 12 is bounced co color server 20 at 
step 93. 

If ager.c 41 receives cookie 55 from user 12, agent 41 and 
commercial server 13 have enough information to provide user 
12 with color corrected information ac step 99A as requested 
in image request 54. 

Ac step 94Q user 12 is bounced to commercial server 13 
along with domain 19 cookie 66Q. Ac step 95Q image request 54 
is resent. Ac step 95Q, agent 41 detects domain 19 cookie 
65Q. Commercial server 13 may use 66Q and image file 52F to 
provide user 12 wich color corrected information at step 99Q 
as requested in image request 54 

Referring again to Fig. 2, a mechod of sharing data 
blocks according cc a third embodiment of the present 
invention begins a: seep 90 with request 54 from user 12. 

Ac scec 91, acenc 41 checks user 12 for a cookie 65. 
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At step 92 agent 41 determines if cookie 66 or 
information 921 has beer, received. If cookie 56 is not 
present and inf ormaticr. 921 is present, agent 41 becomes a 
user and re quests characterization and or calibration. 
information for user 12 f rom color server J2 Ch_ Inf ormation 921 
must be enough information to permit to color server 20 to 
recognize user 12 as the beneficiary of the surrogate client 
action of agent 41 . 



If agent 41 receives display calibration or 
characterization data 3 3 from color server 20, agent 41 drops 
cookie 65R to user 12. Using cookie 66R, agent 41 and 
commercial server 13 have enough information to provide user 
12 with color corrected information at step 99A as requested 
in image request 54. 

Nodes connected to network 13 may include various 
combinations of displays and electronic devices and may also 
include a variety of video hardware 68 and video software 70. 
Video hardware 63 ray include video cards, boards, chips and 
accelerators. Video software 70 may include drivers, applets 

and applications . 

Display calibration and or characterization data 38 does 
not exist for user 14 in standard condition. Thus, user 14 
may not receive color corrected images according to the 
present invention. Request 54 from user 14, requesting image 
file 52? from commercial server 13 will cause agent 41 to 
initiate examination 32. Examination 82 may be a request for 
a cookie or calibration and or characterization data, and will 
not yield any calibration and or characterization data of any 
form from user 14 . Agent 41 may be implemented as a software 
filter, an application or any other suitable technique. 

User 14 has r.c calibration and or characterization data 
to return to commercial server 13. Upon receiving no 
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calibration and or characterization data in response to 
examination 32, agent 41 may cransrr.it response 43 to user 14. 
Response 43 may cause user 14 to transmit request 31 to color 
server 20. Server 20 has no calibration and or 
characterization data to return and may transmit response 33 
to user 14. Response 23 may include a unique identifier ID to 
identifv user 14 and cause commercial server 18 to drop a 
cookie SSZ zo user 14. Cookie 66E may be considered an empty 
cookie, it contains only unique identifier ID and will not 
allow commercial server 18 to produce corrected -images to user 
14. 

Alternatively, missing, inadequate, corrupted or 
otherwise unusable calibration and or characterization data 
from color server 20 may initiate inquiry 3 5 from color server 
20 to user 14. Inquiry 35 may be an invitation or other 
initiation to user 14 zo engage in remote or local calibration 
and or characterization. If user 14 declines to calibrate or 
characterize, image 5 2 displayed by user 14 would be 
uncorrected. 

User 12 may be calibrated and or characterized locally or 
remotely. J^>cai calibration and or characterization is 
discussed in U.S. Patent No. 5,638,117 to Sngeldrum & . 
Milliard . Remote calibration and or characterization is 
discussed in more detail below. After calibration and or 
characterization according to the present invention, display 
calibration cr characterization data 38 may be stored locally 
on local storage 23 of user 12 or stored remotely in database 
46 on color server 20 or as data file 72. Calibration and or... 
characterization data 3 3" may be stored as cookie 66, a block 
of data, or some similar method using other network protocols. 

Recuest 5 4 from user 12, requesting image file 52? from 
commercial server 13 will cause agent 41 to initiate 
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examination 32.' Examination 82 may initiate return of cookie 
66 to. commercial server 13 if cookie 66 was initially 
generated by an element within domain 19. Examination 82 may 
also initiate return of display calibration or 
characterization data 3 3 to commercial server 18. Return of 
either cookie 6c or display calibration or characterization 
data 3 8 may permit commercial server 13 to correct image file 
52? for display cr. display 22 as image 52. 

If cookie 65 was deposited by a foreign domain and is 
inaccessible, or display calibration or characterization data 
38 is missing or inaccessible, examination 82 may return no 
data. Upon receiving no calibration and or characterization 
data in response to examination 32, agent 41 may transmit 
response 43 to user 12 . Response 43 may cause user 12 to 
transmit request 31 to color server 20. Request 31 may Color 
server 20 may transmit response 37 to user 12 which causes 
user 12 to transmit data 21 to commercial server 13. Data 21 
mav contain display calibration cr characterization data 38 
and or other user profile information. 

In modified condition, user 16 may have been calibrated 
and or characterized locally or remotely to generate a foreign 
calibration and or characterization file 74. Foreign 
calibration or characterization data 74 may be stored locally 
in electronic device 78 or stored remotely. Calibration and 
or characterization data 74 may be stored as cookie 80, a 
block of data, or seme similar method using other network 
protocols. Agent 41 may detect foreign calibration and or 
characterization file 74 or cookie 80. Upon detection of 
cookie 30 or foreign calibration and or characterization file 
74 agent 41 may translate the foreign files to translated data 
34 to enable correction of images according to the present 
invention. Alternatively, agent 41 may also bounce user 15 to 
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color server 20 along with translated data 84 to enable color 
server 20 zo crop translated data cookie 85 onto user 16. 
Translation of foreign calibration and or characterization 
file 74 or cookie SO nay also be accomplished by color server 
20. 

The above process rr.ay be repeated as many times as 
necessary in order zz satisfy requests made of a server by a 
client , 

The domains enumerated above need not be distinct from 
each other. For example, a domain that has a cookie it wishes 
to share and the domain that distributes the cookie could be 
the same domain. Likewise, the domain that has a cookie to 
share, the domain that distributes the cookie, and the domain 
that requests the cookie could all be the same domain as well, 
data block sharing according to the present invention might be 
required if a domain and its cookies are partitioned by URL 
ranges . 

The act of sending the client from one domain to another 

in order to retrieve information may be done using any or a 

multiplicity of methods including the use of a page 

description language including HTML or XML, by using some 

scripting language such as JavaScript or V3Script, or by some 

combination of the above. For example, HTML tables using HTTP 

POST or HTTP GET commands c an be used, ir conjunction with 
. — . ^^ ^^'^^^^^^^ 

JavaScript or VBScript tg> jr"-™-»«-- * n^ er-page, and th us inter- 
domai n, transfers. 

Methods of supplying the information returned by a cookie 
sharing server may include, but are not limited to, responses 
to forms, additional URL header fields, or additional cookies 
in a URL's contain. 



Remote Characterization 
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Referring now to Fig. 3 A, a user of a local computer 100 
may desire character ization and or calibration of one or more 
input/output devices su ch as display 102, scanner 104, other 
image input device' 105, printer lOS^ lotter 110, or other 
image output device 112. Computer 100 may be connected via a 
wired or wireless network such as network 114 or directly via 
modem cr cable cr ether means to a remote server 116 where 
software 113 and data 120 needed for characterization may be 
-stored. 

After link 122 is established between a Remote Server 116 
and computer 100. either server 116 or computer 100 may 
request characterization and or calibration service from a 
remote server on behalf of computer 100. Server 116 may then 
initiate a characterization program 124. Characterization 
program 124 ray send one or more characterization images 126 
or test patterns to computer. 100 and its associated devices 
102, 104, 106, 109, 11C, and 112. If the device to be 
characterized is ar. output device such as display 102, printer 
ICS, ciotter 110 cr irr.age output device 112, characterization 
cr test image 125 -ay be presented to a user or a local 
calibration r.echanism 128 using computer 100 's manner of 
output onto the selected device. 

If the device to be characterized is scanner 104, image 
caoture device 105 or other image input device 106, 
characterization cr test image 125 may be presented to the 
user or local calibration mechanism 128 using a conventional 
input from the device to be characterized and a conventional 
output onto display 102 or any other device. 

Referring now to ?ig. 3B, a process 131, of remotely 
characterizing display 102 according to the present invention 
begins at step 13 3 with a request 125 for characterization 
that may be initiated by computer 100 or server 116. At step 
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132, based upon request 125, server 116 initiates 
characterization program 124. At step 134, characterization 
program 12 4 -hrough server 116 transmits image 12 6 or other 
test pattern which may then be presented to the user or local 
calibration mechanism 123 on display 102 or other device to be 
characterized. At step 136 a user or local calibration 
mechanism such as calibrator 128 may make one or more choices 
based or. the image or test pattern as it appears on display 
102. Choices made by a user may be made in any conventio nal 
manner as through keyboard or mouse ent ry or any- other _ 
suitable tactile teeaoack device, a user may also indicate 
their preferences in other ways such as verbally. At step 138 
the choice or choices may result in choice data 15 0 or other 
quantifiable data that may be captured locally and or 
communicated back to characterization program 124 on server 
115 for capture. 

One of the choices to be made by a user may be to select 
a level of thoroughness of the characterization and or 
calibration. Characterization program 124 may provide one or 
more options for device characterization including full or 
partial characterization, or multiple levels of 



characterization complexity". At step 140 characterization 
program 124 determines if a sufficient number of images or 
test patterns have been sent to computer 100, and if a 
sufficient number of responses have been captured to complete 
the level of characterization desired. In another aspect of 
the present invention characterization program 124 may also 
evaluate choice data 150 to determine if sufficient data has 
been received to adequately characterize computer 100 at the 
desired level. If insufficient data has been captured 
characterization program 124 may repeat process 131 from step 
134 until sufficient choice data has been captured. 
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After choice data 150 has been transmitted to server 116, 
choice data 150 r.ay be used by characterization program 124 or 
other electronic algorithm to create characterization file 152 
about the device to be characterized. 

Characterization file 152 might be used for one or more 
of the following applications: 

send characterization file 152 to computer 100 for local 
usage including, but net limiced zo, providing operating 
system 101 of computer 100 with information about the color 
capabilities of coirputer 100 and/or 

subsequently use characterization file 152 or other 
characterization information for modifying or otherwise 
controlling the flow cf images such as still image 154 or 
streaming images 155 for display, output or other use by 
computer 100 based or. the contents of characterization file 
152 and/or 

store characterization file 152 or other characterization 
information locally en a network node such as server 115 or 
other computers connected to server 115 and/or 

send characterization file 152 cr other characterization 
information to a third location such as server 158, and/or 

feed into creation or alteration of the test patterns, 
images, or other calibration and characterization implement 
such as image 125 and/ or 

otherwise provide characterization file 152 or other 
characterization information for use by software 118, other 
programs, or other devices in providing images or other 
services to computer 100 . 

REMOTE CHARACTERIZATION 

Referring now to Fig. 4, in another aspect, the present 
invention may include a combination of client software 160 and 
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server software 152 connected using network 164 and using 
suitable network prctccols such as Internet protocols 166. It 
is expected that many individual local cornputers such as 
computer 168 may from time to time connect to any of a number 
of remote servers such as server 170 over a network such as 
network 164 which may be the Internet. At computer 168 with 
display 172 as the device to be characterized, a user may 
initiate a recues: such as requesc 174 to server 170. Server 
170 may incorporate images, data, test patterns, and/or logic 
embodied in onto an appropriate hardware platform 178. 
Program 176 or other suitable characterization programs may do 
one or more of the following: 

(a) manage communication link 180 with computer 168, 

(b) select one or more appropriate characterization 
images and or test patterns or other test data such as image 
182 to be sent to the device to be calibrated. The selection 
of appropriate test images may be determined by the level of 
complexity of characterization desired, by the hardware to be 
characterized, bv the characteristics of the connection, or by 
characteristics cf images to be displayed. 

(c) create, change or alter existing calibration images 
or test pattern to send and/or change the order thereof if 
required, 

(d) send one or more calibration images and or test 
patterns, 

(e) collect characterization and or calibration data such 
as choice data 184 returned from computer 168, 

(f) create characterization information such as 
characterization file 186 from analysis of the images or test 
patterns such as image 182 sent and from the responses such as 
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(g) store characterization file 135 on server 170 and/or 
connected rr.achir.es such as server 171, 

(h) use characterization file 136 to modify images such 
as image 190 or to change the flow of unmodified images such 
as images 132 sent tc computer 153 

( i ) transmit characterization file 135 co other sites 
such as site 134 for use at those sites to provide services 
such .as data 136. which may include programs, data and or 
images, to computer 153 or other purposes and/or 

(j) transmit characterization file 136 to computer 168 
for local usage. 

For example, the present invention might be used as a 
technique to characterize client monitors over the Internet 
and to use the characterization information to color correct 
images sent to that client so as to provide accurate color 
display over the Internet. 

Correction Notification 

In another aspect of the present invention, computer 168 
may be provided with icon 173 over network 154 to indicate the_ 
color correction status of images on the display. This 
information is critical since the end user is often in a 
remote location, separated in time and distance from the 
author of the image or images, and unable to know the 
characteristics of the image or images being viewed. In 
particular, the present invention may automatically inform 
viewers and/ or other receivers of digital images as to the 
state of color correction for the digital images, thus 
notifying a viewer of the visual integrity of the digital 
image being displayed. Consequently, viewers may feel assured 
and secure about images they see as to the color accuracy of 
those images . 



WO 00/29935 



- 20 - 



PCTAJS99/26943 



In particular, the present invention may be implemented 
as a software process chat may be a stand alone application or 
i: r^ay be loaded into either an Internet browser or server 
technology. A browser is a client application that enables, a 
5 user to view HTML (or equivalent) documents on the web, 

anocher network, or the user's computer. The software may be 
implemented in the form of a small program or an applet, 
including Java or ActiveX application programs, that may be 
loaded into a web browser, such as Microsoft's Internet 

10 Explorer or Netscape's Navigator. The software -may also be 
implemented on server technology, such as Cosmo Color from 
Silicon Graphics. One skilled in the art will recognize that 
other conventional or newly developed software processes may 
be used as well and the invention may be implemented using 

15 hardware or a combination of hardware and software. One 

skilled in the art will recognize that the invention can apply 
to other browser technology, such as local CD browsers and 
other non- Internet browsers. 

Referring to Fig.'s 5A and 5B, a flowchart of process 240 

2 0 for implementing the present invention through a sample 
network 242 is illustrated. For example, using Internet 
protocols, the present invention is typically enabled when 
browser 244 begins to reassemble web page 246 on display 248, 
following the hidden HTML codes or other protocols in web page 

2 5 246 to determine where to place one or more elements such as 

element 2 52 which may be text, images, graphics or videos 
onscreen. In particular, algorithm 256 may be implemented 
when browser 244 begins to assemble element 252 or other part 
of a requested page. One skilled in the art, however, will 

3 0 recognize that implementation of the present invention can be 

initiated at anytime a page e lement requi ring accurate color 
or gray scale including a q ya r h ^ m*n& or video is present. 
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Color or gray scale accuracy is identified here as high 
fidelity or identical rendition of a page element as compared 
to the image of the page element as viewed on the authoring 
display. 

The technique according to the present invention 
initially determines whether the image has been color enabled 
as shown at step 241 and subsequently whether a user such as 
client 25Q has been color characterized or corrected as shown 
at step 243. To detect whether an image* is color enabled 
according to the present invention, an algorithm such as 
algorithm 256 may detect whether color correction information 
such as color specific files 258 or registry entries 260 are 
associated with a page element such as element 252. Color 
correction inf orttation may also include: (1) user specific 
Hypertext Markup language (HTML) tags within the web page that 
designate the color properties of the source image such as 
tags 252, (2) standard ICC profiles such as profile 264 which 
may be embedded within "he image file itself and (3) pointers 
to user specific .'i.e. HTML) or standard (i.e. ICC profiles) 
color files associated with the image file such as color 
specific files 25S. At step 245, algorithm 255 may determine 
whether network 242 is acting in accordance with steps 241 and 
243 above to provide a faithful rendition of element 252. 

Upon determining whether the image is color enabled at 
step 241 and whether client 250 has been color characterized 
at step 243, notification element 254 may be provided about 
the integrity of color imagery currently being viewed by the 
client at a specific web site. In particular, at step 245 
when an image such as element 252 is color enabled and 
corrected, notification may be provided to a client such as 
client 250 that the color of the image is accurate. If the 
image is not color enabled, at step 247 notification may be 



WO 00/29935 



- 22 - 



PCTAJS99/26943 



provided to the client chat the color of the image may not be 
accurate. If the client is not color characterized or 
calibrated, at see? 249 notification may be provided to the 
client: that the color of the image may not be accurate. 
Notification steps 247 and 249 may result in the same 
indication to client 250 or distinct notifications may be 
used. After notification of client 250 at either steps 245, 
247 or 249, algorithm 256 may enter a standby mode until 
another web page with image elements is detected. 
Notification element 254 may be a part of web page 246 
delivered from a network server or notification element 254 
may be generated or. device 259 for display on display 248. 

In a currently preferred embodiment of the present 
invention algorithm 255 may detect whether a web page such as 
web page 246 includes predetermined HTML tags such as tags 
262. For example, when a web page with an image is color 
enabled, the HTML tags direct a browser to display a 
predeterr.ir.ed text as a headline of a certain size, such as 
the title ° T rrarr.et Color"'". 

Referring now co Fig.'s 6A and 6B, a screen view of a web 
cage 266 having a title "True Internet Color™" (True Internet 
Color- is a trademark of E-color Inc.) in title bar 264 and 
HTML file 270 that created it are shown. The presence of 
indicator 263 such as "True Internet Color" in a tag such as 
tags 262 may enable algorithm 256 to recognize that images on 
page 256 are color enabled. Thus when a web page includ es^the 

*H f,i a -True internet Color""' the image is consid ered to be 

"coTor enabl ed. J The present invention is not limited to 
recognition of HTML tags directed at the title -True Internet 
Color™," but rather, indicator 263 may use any predetermined 
cag configuration such as HTML tag, or web image tag 
c on f i gura t i on . 
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<html> 



Marks the beginning of 
an HTML -coded file 



<head> 



10 



15 



<title>Shop-o-rama True Internet 
Color (r) </title> 



20 



Marks the start of the 
header section and may 
contain descriptive 
information not 
displayed onscreen 
such as the title and 
author. It may also 
holds formatting 
information, such as 
style sheets. 

Sets the web page's 
title, displayed in 
the blue bar atop the 
screen. This also 
affects the displaying 
window' s externally 
viewable and or 
detectable attributes. 



</head> 



25 



30 



Marks the end of the 
header section and may 
contain descriptive 
information not 
displayed onscreen 
such as the title and 
author. It may also 
holds formatting 
information, such as 
style sheets. 



35 



</html> 



Marks the end of an 
HTML-coded file 



To determine whether an image such as page element 252 is 
color enabled via ICC color correction information, a system 
40 according to the present invention such may detect whether ICC 
profiles (for the device characteristics of the reference 
image as represented on the reference device) are embedded 
within an image file, such as element 252, based upon an ICC 
profile format specification. In particular, che present 
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invention may detect data 253 stored in ICC profiles such as 
profiles 25 5, which are described m cne icu protile 
specification. ICC profiles such as profiles 255 are device 
profiles that car. be used in pairs to translate color data 
cr eated on one device such as de vice 257 into a native color 
space C of another device su ch as device 259. More 
specifically, an ICC profile such as profile 251 may be 
provided for each device such as device 257 and may be used 
according to the present invention to transform color image 
data such as element 252 from a device-dependent- color space 
to the profile connection space, and to transform color image 
data from the profile connection space to another device- 
dependent color space. ICC profiles such as profiles 255 for 
the device characteristics of the reference image as 
represented on the reference device may be embedded in the 
image file such as element 252 or stored in a memory in a 
connected computer such as device 253. For example, the ICC 
profiles could be stored in a memory, accessible by a CPU, and 
associated with the image instead of embedded. Additionally, 
it should be noted that ICC profile can be accessed by the 
client from a variety of other sources such as network 
interface or from other external devices via a modem 
interface . 

To determine whether an image is color enabled— even 
without an embedded or associated color profile a system 
according to the present invention may detect whether the 
image is in a known c olor space, such as sRGB . sRGB is a 
well-defined color space, includes various versions such as 
sRGB 64, and is further defined at http://www.srgb.com. One 
skilled in the art will recognize that implementation of the 
oresent invention may be used with any kinds of images, 



WO 00/29935 



- 25 - 



PCT/US99/26943 



including but net limited to those subject to compression 
techniques, such as GIF, PNG or JPEG formatted images. 

Referring tc step 243, the present invention interrogates 
the client system to determine if that system is characterized 
and calibrated to the same state, or to a different but known 
state. In ether words, the present invention detects the 
presence of a transfer function in the client system, i.e. in 
the hardware or software (or the combination of 
hardware/ software and human perception).- In particular, the 
present invention checks file entries and registries, or 
pointers to such entries and registries, to determine whether 
characterization parameters are present. A flag, initialized 
to a set value, signals whether the client system has been 
characterized. For example, in a typical embodiment, a binary 
flag initialized tc a zero value is set to a non-zero value 
when the present invention detects the client system is 
characterized. In accordance with the present invention, a 
client may use any type of conventional or newly developed 
color calibration system including, for example, the 
interactive color calibration method disclosed in U.S. Patent 
No 




Referring to step 16, the present invention then 
determines the whether the system is acting in accordance with 
steps 12 and 14 above to provide color accuracy. In 
particular, once the present invention confirms that the 
presence of color correction information in the displayed 
image (step 12) and the image has been adjusted, as needed, to 
display properly on the calibrated or characterized client 
system (step 14) (i.e. color accuracy is being provided for in 
step 15), a notification is displayed to the user (step 13) . 
When the software process determines that color accurate 
display is occurring on all or part of the image, then an 
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appropriate notification is made to inform the user that color 
correction has occurred where marked. One skilled in the art 
will recognize that -he particular type of notification is not 
critical to the invention. The notification may be visual or 
non-visual notification (e.g. audio) . For example, the visual 
notification may be an icon that provides users with a visible 
indication about the integrity of color imagery currently 
being viewed by the client at a specific web site. It does 
this by briefly flashing the cursor for a fraction of a second 
to indicate if whether or not the page is being .viewed 
utilizing color correction. This icon can be implemented in 
addition, or instead, in the OS, in a web-enabled application, 
or in a browser (when implemented on as a client- side 
application) ; or it can be implemented as an image, tag, 
program, or watermark embedded within a web page by the web 
server or by any of the links between server and client within 
the network infrastructure. 

Per example, when a user requests a Web page from a web 
site enabled by -he present invention, the HTML is sent to the 
client directlv from the web site's main servers. A specially 
attached URL link calls up color-corrected images from the 
hosted server, and the client's browsers integrate the two 
pieces automatically. Thus, in accordance with the present 
invention, the notification not only provides notification 
feedback to the user, but also reinforces a message of data 
fidelity to the end-user in determining whether the color data 
is accurate or not. The present invention has applicability 
for any client viewing or display application where color 
accuracy is important to the communication of information. 
Examples include, but are not limited to, viewing artwork, 
fashion, cosmetic, logo or brand colors, paint, photography 
and other color-sensitive information over a medium such as 
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the Internet where concent viewer and content creator are 
disconnected by physical space and/or time. Although, for 
illustrative purposes, the present invention is described and 
illustrated utilizing web pages hosted on a server and 
displayed with color correction on a client, the invention is 
not limited to such a configuration. Rather, the present 
invention would apply equally well to images displayed on any 
imaging peripheral including transmissive, reflective, and 
other source and/or client imaging technologies. Moreover, 
the present invention would also apply to images not viewed by 
the Internet, such as images within computer applications, TV, 
broadcast, or other client output media of any kind, including 
printed output. The present method would apply to both 
digital images and analog images including both real and 
synthetic images authored for, and/or viewed on, a client 
system. 

The present invention may be implemented as a client- 
based notification system 30 as shown in FIG. 7 or server- 
based notification system 50 as shown' in FIG. S. With respect 
to a client-based notification system, the present invention 
may be installed on a client system such as client 38, 
peripheral, and/or other output technology that has various 
states of visual display to notify the user about the state of 
color correction for digital images output or displayed. 
Referring to FIG . 7, a functional block diagram of a client- 
based notification system 30 for providing critical end user 
feedback as to the color correction status of imagery on a 
client display is illustrated. Client-based notification 
system 30 is shown with hosted color server 32, mirrored 
server 34, non-mirrcred server 36 and clients 39, 40, 42, 44 
and 45 which represent the various types of clients, that is, 
clients such as 39 and 40 which include the client based 
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notification techniques' of the present invention (indicated by 
the term "icon"), clients 38, 4C. 42 and 44 which are 
characterized fcr color, clients 42 and 44 which have a known 
transfer function and client 46 which is not characterized, 
has r.o known color transfer function and does not include a 
notification syste- according to che present invention. 

Icon 65 depicted in Fig. 9(b), provided by client 38 is 
preferably initiated to a non-corrected state. When client 38 
sends a request to mirrored server 34, which mirrors hosted 
color server 32, a color corrected requested image is sent 
from hosted color server 32 to client 38 including a color 
notification tag, such as a specific HTML title bar flag. The 
Web page HTML from server 34 includes a color notification tag 
within its HTML tags to indicate in the title bar that the 
images to be sent by server 32 have been enabled for color 
correction. For example, as shown in FIG. 6A, the title bar of 
the web page may include a notification in its title bar, such 
as "True Internet Color", in addition to ether terms such as 
che name of a related company, tc indicate color correction. 
As noted above, one skilled in the art will recognize that the 
present invention is not limited to the detection of 
predetermined HTML title tags, rather, any device capable of 
detection may be used as the color notification tag. Upon 
arrival at the client 38, the present invention detects the 
color notification tag by evaluating the HTML tags sent from 
server 34 to determine whether the image delivered from server 
32 has been color correction enabled by detecting the True 
Internet Color tag in the title. It also checks whether client 
38 has been color characterized or calibrated to a known 
state. If both conditions are true, an icon such as icon 66 
depicted in FIG. 9(b) is changed to a corrected state as 
depicted by icon 64 in FIG. 9(a). In contrast, when client 
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38 sends a request to a site providing non color corrected . 
pages, such as non-mirrored server 36, which is does not 
include the special HTML tags, such as "True Internet Color" 
to indicate color correction, then icon 65 remains unchanged 
from its non-corrected default state. 

Still referring cc FIG. 7, local client 40 is 
characterized but includes no applet incorporating the present 
invention for notification as indicated by the phrase w no- 
icon" . Local client 40 is in direct communication with 
mirrored server 34 and hosted color server 32. Local client 
40 provides no notification icon. When local client 40 sends 
a request to mi rrc red - server 34, the requested image is color 
corrected and sent back by hosted color server 32, with no 
notification icon on client 40. When local client 40 
communicates with non-mirrored server 36, the requested image 
is not color corrected, and there is no notification icon to 
this effect. 

Client 42 is characterized and includes a known 
(characterized :r calibrated) transfer function but no applet 
incorporating the present invention for notification. Client 
42 is in direct communication with mirrored server 34 and non- 
mirrored server 3 6 and in direct communication with hosted 
color server 32 via redirection requests from mirrored server 
34. Client 42 provides no notification icon. When client 42 
sends a request to mirrored server 34, the requested image is 
corrected. However, no notification indicating color 
correction is sent back to client 42. When client 42 sends a 
request to no'n-mirrored server 36, the requested image is not 
color corrected and no notification of color correction is 
sent back to client 42. In such case, the title bar of the web 
page would net indicate a color corrected image. 
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Client 44 is characterized and includes a known 
■(characterized or calibrated) transfer function and includes 
an applet incorporating the present invention for 
no-* ficaticr. . Client 44 is in direct communication with 
mirrored server 34 and non-mirrored server 36 and in direct 
communication with hosted color server 32 via redirection 
requests from rr.irrored server 34. Client 44 provides a 
notification icon. V/hen client 44 sends a request to mirrored 
server 34, the requested image sent by hosted color server 32 
is color corrected. In such case, the title bar- of the web 
page would indicate a color corrected image. Notification 
indicating color correction is sent back to client 44 
indicating a color corrected image being displayed. When 
client 44 sends a request to non-mirrored server 36, the 
requested image is not corrected and no notification" of color 
correction is sent back to client 44. In such case, the title 
bar of the web page would not indicate a color corrected 
image . 

Client 46 is neither characterized nor includes an 
application incorporating the present invention for 
notification. Client interacts with non-mirrored server 36 
only and provides no notification icon. When client 46 sends 
a request to nor. -mirrored server 36, which is not in mirror 
communication with hasted color server 32, the requested image 
sent by non-rirrored server 36 is not color corrected and no 
notification is provided to the client 46. In such case, the 
title bar of the web page would not indicate a color corrected 
image . 

Referring now to FIG . 8, a functional block diagram of a 
server-based notification system 50 for providing critical end 
user feedback as to the color correction status of imagery on 
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a client display is illustrated. With respect to a server- 
based notif icaticn system, the present invention may be 
installed on a web site server to notify the user about the 
state of color correction for digital images output or 
disolayed. In particular, the icon of the present invention 
can be implemented in an image, tag, program, or watermark 
embedded within a web page by the web server or any of the 
links between server and client within the network 
infrastructure. Server-based notification system 50 is shown 
with hosted color server 52, mirrored server 54,- non-mirrored 
server 56 and clients 53, 60, 62 and 64. The icon of the 
present invention is installed in hosted color server 52 and 
mirrored server 54 and not in non-mirrored server 56. 

When client 55 sends a request to hosted 52, client 58 
may communicate through some means that it is a client that is 
of a specific, known calibration. This notification may be 
included in the HTML stream sent by the browser, or via any 
other method.. In that case, if a color corrected image is sent 
from nested color server 52 (or from mirrored server 54) to 
client 53, then an icon is also sent by mirrored server 54 or 
by hosted color server 52 to indicate that the image has been 
corrected. In contrast, when client 58 sends a request to 
non-mirrored server 55, which is not in communication with 
hosted color server 52, non-mirrored server 56 does not 
include an icon (or sends an icon indicating that no color 
correction has occurred) . 

In accordance with an alternative embodiment of the 
invention, client 62 is characterized and includes an applet 
incorporating the present invention for providing 
notification. local client 50 is in direct communication with 
mirrored server 54 or hosted color server 52, which also 
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includes the notification icon. When client 60 sends a 
request to rnirrored server 54 or hosted color server 52 as 
described above, the requested image is color corrected and 
sent back by web site server along with a notification icon 
indicating a corrected state. Mirrored server 54 also sends 
the HTML tags indicating color correction and the icon on 
client is changed t3 indicate the corrected state. Logic is 
implemented to arbitrate between the state of the- two icons 
(server-based and client-based). For example, in one 
embodiment either the server or client based notification icon 
may take precedence while in another embodiment a third icon, 
similar to the icons shown in FIGS. 5(a) and (b) , may be used 
to indicate the presence of a different level of color 
correction based cr. the presence of both server and client 
based notifications. 

Client 62 is neither characterized nor includes an 
application incorporating the present invention for 
notification. "When client 62 sends a request to server 54, 
then either server 52 would use HTML tags to add some 
watermark or ether image to the web page to indicate color 
accuracy; or server 52 would request web server 54 to send an 
image which already has an icon superimposed on the image sent 
by server 54. When client 62 sends a request to non-mirrored 
server 56, the requested image sent by non-mirrored server 56 
is net color corrected and no notification is provided to 
client 62. In such case, the title bar of the web page would 
not indicate a color corrected image, and no icon would be 
sent by non-mirrored server 56. 

In accordance with an alternative embodiment of the 
oresent invention, depending upon the relationship between the 
mirrored server 54 and hosted color server 52, hosted color 
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server 52 may require mirrored server 54 to identify images 
not color corrected. In such case, a server-based icon can be 
ser.z to a client to indicate images which are not color 
corrected. 

In accordance with another alternative embodiment of the 
present invention, multilevel icon certifications may be 
orovided. In particular, multilevel icon certifications can 
"be utilized to distinguish between icon certifications between 
various entities providing for color correction. For example, 
when hosted color server 52 provides color correction, an 
icon identifying not only color correction, but correction 
specifically provided by a particular hosted color server, is 
sent to the client. Or. the other hand, if color correction is 
provided by another entity, an icon identifying color 
correction, without identification of a specific entity 
providing for correction, is sent to the client. 



PARTIAL FILE PROCESSING 

•To increase the speed of providing color corrected images 
co a user, commercial server 13 of Pig. 1 may store partially 
preprocessed data files such as image files or may partially 
preprocess data files on- the- fly. Similarly, only that 
portion of a compressed image file necessary to correct the 
color need be decompressed for color correction thus 
expediting the process. In general; images available on 
network 20C may conform to one or more compression standards 
to permit greater throughput of information and higher inter- 
connectivity. Several standard image formats such as JPEG 
(Joint Photographic Experts Group] , or MPEG (Motion Picture 
Experts Group) , or GI? (graphical interchange file format) may 
be found or. a network such as the Internet. 
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Referring new to Fig. 10 process 300 is a conventional 
techr.icue for image compression such as, for example a JPEG 
format. Image 3C2 may be any image such as a line drawing a 
black and white or color photograph or any other image. Image 
302 is compressed by compression device 304 according to a 
compression standard, here JPEG standards and results in JPEG 
file 305. A compressed file such as a JPEG file 306 may have 
several identifiable elements, such as luminance element 303, 
color element 310, and miscellaneous elements 312 and 314. 
Miscellaneous elements such as element 312 may include 
information unnecessary for the ultimate display of a color 
corrected images over a network, such as a thumbnail image. 
Other compression standards may have different elements and 
may function similarly for color spaces using different 
specification characteristics . 

A compressed image file such as image file 315 may be 
partially uncompressed to expedite color correction as shown 
in Fig. 10. At step 317, file filter 313 processes image file 
315 to separate compressed luminance elements and compressed 
color elements such as compressed i-jminar.ee element 316L ana 
compressed color element 316C respectively. Unnecessary file 
elements such as miscellaneous elements 312 and 314 of Fig. 10 
may be discarded to expedite processing. Compressed color 
element 316C is passed along at step 319, no processing of 
compressed color element 316C is required according to a 
currently preferred embodiment of the present invention. 
However, use of other color spaces or compression techniques 
may require some processing of a generally unused element such 
as compressed color element 316C and may result in processed 
elements such as element 322. 

At step 3 21 cne or more file elements needing correction 
such as luminance element 315L may be decompressed to form 
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correctable elements such as correctable element 320. 
Following step 321 alternate paths may be used. 

In a first embodiment of the present invention at step 
325, correctable element 320 and element 322 may be combined 
using data combiner 324 to form intermediate file 326. 
Intermediate file 325 has shared elements with compressed 
image file 31c. Correctable elements such as correctable 
element 320 may be uncompressed awaiting correction and 
elements not requiring processing such as element 322 may be 
combined in one or more uncorrected intermediate, format files 
such as uncorrected intermediate file 326. Upon receipt of 
user color data such as display calibration or 
characterization data 3 3 of rig. 1 , uncorrected intermediate 
file 325 may be processed at step 323 to correct correctable 
elements such as correctable element 320 according to display 
calibration or characterization data 38 which may be for a 
specific user only or it may be a net correction file as 
discussed below. The result of step 323 may be a corrected 
intermediate file such as corrected intermediate file 32S. 

At step 3 27 corrected elements of corrected intermediate 
file 32S may be compressed according to the compression 
technique being used. The resulting file composite corrected 
image file 332 is a luminance corrected image file according 
to the compression technique being used. 

Referring again to Fig. 1, correction of image file. 52F 
for disolay may include two or more alternate methods. In a 
first, display calibration or characterization data 18D of the 
authoring display 18M may be included with or applied to an 
image file creating a master corrected image file such as file 
237 or uncorrected intermediate file 326 of Fig. 10. Upon 
receipt of user display calibration or characterization data 
233 final correction of image file 237 may be accomplished. 
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Thus file 237 may be displayed on display 206 with corrections 
included for display 203 and display 206. Alternatively, 
author display calibration or characterization data 236 may be 
combined with user display calibration or characterization 
5 data 238 to create a net correction file 239 that may be 
applied to any images authored on display 208 to achieve 
accurate irr.age display. 

In a second embodiment of the present invention at step 
325, correctable element 320 may be corrected co form 
10 corrected element file 330. As discussed above,, upon receipt 
of user color data such as display calibration or 
characterization data 3 3 of Fig. 1, correctable element 320 
may be processed at step 323 according to display calibration 
or characterization data 38 which may be for the user only or 
15 it may be a net correction file as discussed. 

At step 327 corrected elements such as corrected element 
file 330 may be compressed according to the compression 
technique being used. Compressed corrected element file 334 
mav be combined with element 322 in combiner 336 to form 
20 composite corrected image file 333. composite corrected image 
file 332 and composite corrected image file 338 should yield 
identical images when displayed on display 22 of Fig. 1. 

Starting from an original image. file, this technique may 
also be applied by originally compressing a portion of the 
25 image file. The uncompressed portion and the compressed 

portion and the authoring station color characterization data 
may then be combined into an intermediate file format to 
permit fast correction and complete compression for transfer 
to a user. 
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In another aspect, the present invention includes a 
technique for organizing display devices into subsets 
according to their characteristics and thus limit image 
correction to a finite number of perceptually uniform subsets. 
An image presented on display devices within a subset should 
be indistinguishable to a user on ail devices having 
characteristics within the subset. Analysis of the 
relationship between gamma, black-point and luminance for 
display devices such as monitor 3 53 and monitor 361 
demonstrated that within a gamma black-point plane such as 
coordinate system 364 of Fig. 12, subset, areas having limited 
variance luminance may be described. 

Referring new to Fig. 11, in a currently preferred 
embodiment of the present invention network 350 includes two 
or more electronic devices such as devices 352, 354, 356, 358 , 
360 and 352. Electronic devices 352, 354, 356, 353 and 360 
further include display elements such as monitor 252, monitor 
3 55, display 3 57, display 3 59, monitor 3 61 and display device 
3 63 respectively. Display elements such as monitor 3 53, 
monitor 355, display 357,. display 359, monitor 361 and display 
device 3 53 may be characterized using two or more parameters 
such as gamma black-pcint and luminance for CRT displays. 
Non-CRT display devices may use different parameters. 

Referring new to Fig. 12 coordinate system 364 includes 
characteristic axes 365 and 368 illustrating the 
interrelationship between characteristic 370 and 372 
respectively. For conventional cathode ray tubes displays 
such as monicor 35 3 coordinate system 364 has two 
characteristic axes- 365 and 368 for characteristic 370 (gamma) 
and 372 (black pcint) respectively. 

One or mere subset areas such as subset 37 4 may be used 
to identify areas of luminance having nearly-indistinguishable 
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image parameters for CRT display devices such as monitor 361 
and displav device 2 62. Subset areas such as subset 374 and 
subset 37c ray overlap. In a currently preferred embodiment 
of the present invent ion, subset overlapping is required to 
completely cover the characteristic space describing the 
imaging or display dev.ce. As characteristic 370 (gamma) and 
372 (black peine move away from origin 371, subset areas such 
as- subset 373 may include larger or smaller areas than subset 
areas closer to origin 371 such as subset 374. 

Display device parameters 370 (y) and 372 (black point) 
may be obtained from display device characterization as 
discussed above. Thus, when a user device 352 requests an 
image from a correction enabled server 354 , server 354 may 
display parameters such as characteristic 370 (gamma) and 372 
(black point) frcrr. user display calibration or 
characterization data 373 and may provide a pre-corrected 
image such as pre-corrected image 375 according to which 
subset the users display device may be grouped in. A server 
so enabled nay store a finite number of pre-corrected images 
such as pre-ccrrecced images 380 to expedite fulfilling a user 
request for a corrected image according to the subset of the 

users display device. 

Referring now to ?ig. 13. in an alternate embodiment of 
the present invention, a correction enabled server such as 
device 354 may use a combination of pre-corrected images in 
local storage to provide to display devices having subsets in 
area 386, pre-corrected images in central or network storage 
for the smaller yet significant number of display devices 
having subsets in areas 384 and on- the- fly image correction 
display devices having subsets in areas 382. Other 
combinations of tmage correction and storage may be used. 
Distribution area 335 may also be characterized in terms of 
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_ mQ . e OMr .-~ 8 of display 353, input or output device, 

one or more pa. a ^ . . . ^ 

„ in terms o £ scr.e ,*.r i^t - useful ch.r.ct^.txc 
used to subset --lay --ices or images. The distributions 
need „oc be United to a unidimensional characteristic, they 
M y be multidimensional and encompass many display or imaging 
parameters. 

ngTOHMTBIKG aPT ""^ OF MTf DISPIAY 

referring nc, to Fig. 14. in another aspect, the present 
invention includes a method and apparatus to establish tne 
input/cutout characteristic (I/O), and operating point such as 
ooint 392. and to determine I/O curves of displays such as 
curves 394 and 355 that may be applicable to any type or 
disolay technology such as display 357 o£ Fig. U. It can be 
used in conjunction with visual or instrumental, 
characterization or calibration methods, The method described 
in this invention is not limited to any particular display 
technology, but it will be described using Liquid Crysta. 
Disolay CCD: technology as an example. An application 
according to the present invention may run 

referring now to Fig.'s 15 and 16, an operating point 
determination method according to the present invention 
includes two parts. The first part, data reduction 400. 
determines the appropriate subset of orthogonal basis vectors 
that describe the space of measured I/O curves such as i/O 
, curve 394 along with the coefficients used to synthesize the 
curves. In principle data reduction 400 need only be done 
once providing the curves used in the analysis span the space 
of all possible curves. It is this property that makes 

. , T _ nrar rire data reduction 4G0 
-h< s a rebus-, general met nod. la practice, 

• ^ - e s-t of display I/O curves, or vectors, 

characterizes a _s-->e =-<- ut u - ^ J 

■n« a «-a^e- se- of orthogonal basis vectors. If each I/O 
using a. s^.a — 
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curve is represented by N input points, then there is a 
possibility that the space containing all measurable I/O 
curves is N-dimer.sior.el . Rarely is an I/O characteristic N- 
dime.-isior.al, usually the dimension is something less than N. 

The second part cf an operating point determination 
method according to the present invention, data application 
402, describes the determination of a specific I/O curve such 
as I/O curve 394 for a users display such as display 357. 
There are no constraints, both visual and instrumental 
approaches are possible. 

Data Reduction 

Referring now specifically to Fig. 15 and 17, at step 401 
data reduction according to the present invention tests 
displays such as display 406 and measures screen luminance L, 
also called screen brightness, as a function of known digital 
inpuz values DV for neutral or near-neutral colors . Luminance 
versus digital inpuz value data may also be compiled from 
existing daza such as ranuf acturers data where available. A 
plot such as graph 412 of measured luminance L, in 
"candelas/m2, versus DV yields a measured I/O transfer function 
such as I/O curve 41G of Fig. 13. Screen luminance may be 
determined using light measuring device 408 which may be a 
spectroradiometer, colorimeter, or other form of light 
measuring device. Such measurement could also be done on a 
relative basis by comparing the displayed luminance relative 
to some reference, such as a "gray scale- or series of know 
areas of reflectance. For I/O curves of specific display 
color primaries, each primary color would be displayed instead 
of the neutral. color. Display color primaries may be red, 
green and blue for a conventional RGB system, other systems 
.. mmA «.,,->. *« ryrs y-n/ or any other suitable 
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The number of input DV to be sampled should be sufficient 
to sample any curvature of the I/O curves such as I/O curve 
41G. Ir. a currently preferred embodiment of the present 
invention fifteen ur.iforrr.ly spaced input DV levels have been 
used, but specific display devices might dictate more or fewer 
levels. The actual number will depend on the instantaneous 
slope such as slope S of I/O curve 410. A higher slope such 
as S- suggests mere samples be used to adequately measure the 
curve, and, with a lower slope such as few samples may be 
used. 

A sufficient number of different display devices that 
span the range of I/C characteristics. of interest need to be 
measured or formula-.ee from useful models. The measured data 
can be one device such as display 4 36 measured at a 
multiplicity of display control settings, e.g. brightness and 
contrast, or mar.y different displays such as monitor 353, 
monitor 355, display 357, display 359, monitor 361 and display 
device 363, ether combinations are possible. 

Ac step 403 data 414 may be tabulated in a matrix format 
such as matrix 416 where rows such as row 418 may correspond 
co each display such as display 4C5 and/or display setting, 
and columns such as column 42 C may correspond to input data 
DV. Matrix entries such as entry 422 may be normalized 
luminance values such as output luminance L. Data matrix 415 
may also be "inverted", resulting in columns such as column 
420 representing the interpolated luminance values and the 
matrix entries such as entry 422 are the input digital values. 
Consistent with the spirit of the invention other 
normalization techniques may be used. In a currently 
preferred embodiment of the present invention fifteen input 
DV values and twenty one different display conditions are used 
yielding a 21 by 15 matrix. 
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als- ^rc-ude data processing to include 
~ s --.v •■■--nar.ce versus normalized DV for each 

L "„v be nortec by dividing by the maximum value xn eacn 
case". This normalization yields a range of zero to 1.0 -or 
both input and output values. 

v a -~x i!6 -s-. be processed ac step 405 oetore PCA. 

" "~'J~ a ..— - ° f each coIurnn 420 ° f data 
;" S "s d^rlnerThe column average is subtracted from each 
row 418 of data matrix 416. This new matrix is -called reduced 
roat^x 426. A covariar.ce matrix 428 is computed by pre- 

- ™ ix 426 by its transpose, transpose 
multiplying recucec ma~ix 4^0 oy _ 
m at-x 427. PCA is then performed on transpose matrix 42/. 
suitable conventional software programs may be used to 

15 carry out the computations . 

a- s-eo 40^ 'rinciole corcponent Analysis (PCA) may be 
oerfc^ed.ia.*.*. .t^=»r.. characteristic vectors, on 

. ^ ic to represent trie 

data matrix iU . "ha Mic idea o, ?CA is P 

la-ge -i measured I/O curves or vectors, by a 

20 set ci crt:-.o S cr.al basis vectors. A weighted linear 

0 . v.,,, vectors are then used to synthesize 

combination c_ t.^ese -as-" 

the complete set of I/O vectors. 

In a currently preferred embodiment of the present 
< nation after PCA at step 407, three vectors v. v 2 and v a . 
2 , plus a mean vector v,. accounted for about 99.88% of the _ 
~ variance in the different I/O curve shapes. This signifies 

some weighted linear combination o- 
that mean vector v- pi-s some weiguu 

basis vectors v„ v» and v 3 , may be used to synthesize eacn o. 
the twenty" one I/O curves used to generate the data c^xte 

_„ t he number of vectors can be more c. 

30 accurately. -•- ' 

, • „ ...... -.^ding on the variety of the measured or 

less cnan -..ree, — » 
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model curve shapes (the vector subspace) used in the analysis, 
and, the precision cf the fit required. 

Mathematically, I/O curve, Lj , at input, j, maybe 
written as the linear combination of the average vector and 
the three basis vectors as shown in equation 430. 

430 

L : = v.. + en vi.j + a: v 2 . ; - + as vs.; 
In equation 43: a : . a 2 and a 3 are the vector weights and 
Vl , v 2 and v 3 are the first three basis, or characteristic, 
vectors determined from PCA in step 407. Since mean vector v* 
and the three basis vectors v lf v 2 and v lf are fixed, only 
three scalar values a,. a 2 and a 3 are needed to describe the 
complete I/O curve such as I/O curve 410. This is a 
significant compaction of the data needed to describe the I/O 
curve. Without this representation it would take at least 
fifteen values, in our case, to describe each curve. 

At step 403 three coefficients a-., a 2 and aj in equation 
43G are determined. Coefficients a:, a 2 and a 3 are not 
necessarily related to any specific point on the I/O curve 
depending on original data matrix 416. If data 414 were input 
digital values then there may be some simple relationship 
between coefficients, a u a 2 and a 3 and some point on curve 
410. For a practical application coefficients ai. a 2 and a 3 
need to be "mapped* or connected to some measurable points on 
the I/O curve. These points can be determined using visual 
methods or instrumental methods. 

For example, coefficients a : , a 2 and a 3 may be determined 
as follows. For each of twenty one I/O curves initially 
measured or gathered, the D V s yielding 25%, 50% and 75% 
relative screen lur.ir.ar.ee may be determined by inverse linear 
interpolation of each I/O curve. That is three DVs for each 
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component channel such as red, green and blue channels in a 
conventional RG3 system. The other data set is the vector 
coefficients needed tc synthesize the curves. Data set 434 
now includes three DVs.. DV 23 * DV 5: , and DV 75 , and three vector 
coefficients a : , a : and a 5 , for each I/O curve 410 and the task 
is tc relate DV and coefficients . 

In another aspecz of the present invention, alternative 
DV sets may be used tc -ore accurately characterize displays. 
DV i3 , DV 3 q, and DV75 may be used for CRT displays and DV33, DV 50 , 
and DV 56 may be used for LCD displays. Other DV sets may be 
used successfully. 

One technique is using polynomial regression to solve for 
b:< in equation 432. 

432 a :< = (biDV 23 + b 2 DV 50 + b 3 DV 75 ) 2 

Other equations may be fitted by either regression or a 
variety of other curve or function fitting operations. 
Another possibility is to use some functional form 
representing a physical model, or, use ?CA again. Yet another 
method might be to linearly or noniinearly interpolate values, 
or interpolate a :< frcm a multidimensional table. 

At step 411, data set 434 includes a set of three vectors 
v : , v 2 and v 3 , plus mean vector v m , and an equation for each 
coefficient a : , a 2 and a 3 that relate the DVs determined from 
the matching by users or by an instrument, to the 
coefficients, or weights, needed to synthesize or construct 
the curve. This needs to be done only once and may be put in 
a database 436 or stored in any other suitable storage system 
as shown in Fig. IS. 

I/O Curve Construction 

Once database 43 f has been constructed a display I/O 
curve 410 for each color channel or neutral gray may be 
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created. The I/O curve thus constructed can be written to a 
file, data set 434, ccrtputer memory 438, or otherwise stored 
for further use ir. system 440 according to data application 
method 402 as pare cf a profile for color management or image 
management. Image management can comprise any archiving of 
images or any for?, of image processing, either spatial or 
temporal . 

Step 413 of data application 402 is to optimize the setup 
of the display such as display 405. It -is possible for users 
to misadjust the display controls such as brightness control 
444 and contrast control 442 so the high luminance levels are 
on shoulder 445 of I/O curve 410, and many of the low 
luminance levels are on toe 448 or lower curved part. To 
optimize operating point 450 of display 406 data for one or 
more setup screens such as data 452 may be transmitted to user 
404 to adjust contrast control 442 and brightness control 444. 

Referring now to Fig. 18, a setup screen 454 permits user 
adjustment of display 406 so there is a differentiation of two 
or more adjacent, or very close, light (brightness) levels at 
high and lew DV. Setup screen 454 may include an array of 
patches or areas 455 and 458 either of gray or other display 
primary colors or color mixtures. Areas 456 and 458 may be 
closely spaced in the highlights and shadow areas of the I/O 
curve. The user is instructed to adjust the "brightness" and 
"contrast", or any ether display controls, to assure maximum 
color or luminance difference between the areas. This will 
help the user to operate the display off shoulder 446 or toe 
448 of I/O curve 410 thereby increasing display dynamic range 

For a conventional LCD display, the "brightness" knob 
generally controls a fluorescent lamp or other light source 
behind the 1C2 and the "contrast" knob generally controls the 
operating point on the LCD. Therefore, the first adjustment 



WO 00/29935 



- 46 - 



PCT/US99/26943 



should be the "contrast" to prevent the user from operating 
the display or. the shoulder of the curve. This may be 
counterintuitive because it apparently causes a decrease in 
the overall screen brightness. However, many LCD displays 
have a maximum luainece of about 50% greater than a bright^ 
CRT. A "bright" CRT may have a luminance of about 100 cd/m 2 -- 
the sRG3 standard is 30 cd/m 2 -whiie many of the better quality 
LCDs have a lurr.ir.ar.ee value of about: 150 cd/m 2 . 

Area 45 5, a: 75%, 56%, or any other suitable scale must 
not impinge onto shoulder 446, and area 458 at 25%, 33% or any 
other suitable scale for example, must not impinge into toe 
448. Achieving an optimum display setting is not critical. 

At steo 415 user 404 is queried for inputs in order to 
determine the values for calculating the basis vector 
coefficients such as a-., a 2 and a 3 . Any combination of three 
or more points between 0% and. 100% may be suitable. 

in another embodiment of the present invention, three 
points from user visual match data may be used to determine 
"coefficients a-, a : and a 3 as shown for example in Sngeldrum & 
Hiiiiard US? 5,623,117. Since there are three vectors in the 
I/O curve synthesis, at least three points are need to 
estimate the three coefficients. With more or less number of 
vectors describing the I/O curves, more or less points may be 
used. There is not necessarily a one-to-one correspondence 
between the number of vectors and the number of points used. 
One possibility is to display three, 25%, 50% and 75% halftone 
screens for each of the display colors, red, green, and blue 
with a number of continuous tone areas immersed in the 
halftone background. This method is not limited to the three 
standard so-called primary colors red, green and blue. In 
fact it is possible to construct a display using cyan, magenta 
and yellow that match commercial printing standards in order 
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to get a better match or other color systems may be used. 
This approach would work just as well with this display or any 
display that used one or more colorants or primary colors. 
Also, the number of points and the percentage values can be 
5 changed to increase precision, or accuracy of coefficient 

determination with any given display such as 33%, 50% and 66% 
or, black, 33%, 50%, 65% and white. The user may select one 
of' the embedded patches such as patch 460 that matches either 
in color or luminance (brightness) of the surrounding halftone 
10 462 . Since the DV for each displayed patch is known, these 

match values determine the DVs that match the 25%, 50% and 75% 
surround halftone screens. It is also possible to use an 
instrument to make this comparison. Other arrangements of 
continuous tone and halftone areas are possible. For example 
it is possible to keep fixed a continuous tone patch such as 
patch 460 and make an adjustment of the surrounding halftone 
such as halftone 462 so there is match between the patch and 
the ha 1 f tone . 

In still another erbodiment of the present invention, a 
20 series of patches 454, or images, of known relative DV 
surrounded by a halftone 462 of known fractional area is 
presented on a screen 454. An observer is asked to select one 
of the patches that matches the halftone background. This 
matching process may then be repeated for two or more other 
25 surround halftone values yielding at least three DV- relative 
luminance pairs. Fractional areas of 25%, 50% and 75% are 
useful but other values may be better in different situations. 

in still another embodiment of the present invention a 
radiation or light measuring device such as light measuring 
30 device 408 may be used and display 406 may be controlled by a 
computer 456 to present all possible light (color) values in 
an automatic method. Computer 465 may be programmed to 
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pe^orm a search to find a displayed area 458 that is closest 

finance to a reference finance, say 75% of the maxima 

~~ ;or e^ght bic syscems this does not mean 

Luminance . r or -Cj, e-yi.u " 

that all 255 levels need to be presented. A binary search 
method would be very rapid, only requiring the display of 
matches equal to the number of bits of radiant resolution. 
" Fo >- an 8 bic display this would retired the display of eight 
a^eas, at most, to find the closest input value to the 75% 
reference value. This process can be repeated for as may 
values or match points as necessary. Other search methods can 
be used, for example, some form of table lookup. 

At step 417 vector coefficients a,, a, and a 3 may be 
calculated from regression equation 432, or from a lookup- 
tab^e or tables, using DVs as independent variables, or 
possibly the relative luminance obtained by making a half tone- 
Pacch match. Other forms of database or data calculations may 
also be used. 

. ,~ ,nn rra-,/ '^p us»d to calculate the 

At step 419 e qua "ion 43 a may ^s-u. 

Tin ^-vs i*0 at each input DV 
display I/O curve sucr. as I/O c— ve -_j 

00 / n , As above example, original data set 414 

"samoled^the input (3V) at fifteen points. This is usually not 
sufficient for specifying a display profile having an 8 bit 
inout having 255 levels. To compute all 256 or more, points 
of the I/O curve, several possibilities are available. If the 
basis vectors such as vectors v,, v 2 and v 3 are smooth 
functions of the input DV they can be fit by polynomials or 
other continuous functional forms. Some form of interpolation 
is also a method that may successfully be applied. Since the 
basis vectors are fixed, these need to be- interpolated only 
once and can be stored. In the case of the functional form 
for the basis vector coefficients equation 430 now becomes 
equation 453 below: 
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U(DV) = *DV)+a, f,(DV) + a2 f t (DV)* a , fj<M 
^ere £.(DV) «y be the polynomials representing the basis 
vectors v. v 2 and v 3 and 0 . DV < 1. A polynomial 
presentation, or other functional representation of the mean 

vector may aisc be used. 

Ke-orst-ucted I/O curve 470 may -overshoot ana o- 
...-de-shoof a. actual curve 410. This means that the 
relative luminance exceeds 1.0, or goes negative. The simple 
t L is to clip I/O curve 470 to 1.0 the first ti*e it exceeds 
1 0. and clip to 0 the first time it goes negative. By 

o^i^ * . AA *i- n f the curve toward the 

checking the 8 bit LET- from the middle of the 
-ends-, one ca., readily determine the first "oversnoot and 
-^ershoot- conditions. Other methods are possib e - as 
locally altering the transition of the I/O curve at the 

^ t TeT-oc-ss of ******* a visual match a user may 
^ectVoatch 472 that generates an unrealistic coefficient 
. are W ways to deal with this, but a simple way » 

t ; ^r". basis vectors v, v, and v, and :ust report mean 
vector v.. Depending on the basis vectors, the mean vector 
a default I/O curve may be adequate for most purposes. 

^ «■» * «T.«MWI / CHARACTERIZATION 

rn another still further aspect, the present invention 
orovJes a method for determining the optimal viewing , «*Uo 
s display, input, or output devices with limited --n . ou pu. 
and/or sensing an S !e characteristics. Referring tc l«. 

. cesc M « et3 510, including test elements 512 and 
and - on 1>y 3creen sl8 which 

and backgrounc 5j.o. is y 

„ ip ,^ 3 . w -th computing device 520. For 
is in communica-iOi. *-v-" ^ 
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l^s-ative ourooses. display screen 518 is a conventional 
1- screen disoiay of liquid crystal display (LCD) (analog or 
Ligttal}, electroluminescent or other technology. One skilled 
.^the art will recognize that the present invention is not 
l"--ed to flat screen monitors, but may be applied to other 
deuces as well, including but not limited to display, input, 
and cutout technologies with similar viewing, output and/or 
so-.^-c" angle characteristics. Test elements may be 
imolemented in the for* of any convenient indicator, such as 
patches as illustrated in the figures shown herein. 

As is illustrated in detail in FIG. 21, test pattern 510 
is d^so-ayed on display screen 518 and includes one or more 
. 3S . elements 512 and 514 having levels of gray different from 

r av shown in background 515. The test pattern 510 of the 
present invention may be initiated, i.e., brought to display 
screen 518, in a number of ways, including clicking on an icon 
shown on display screen 518. One skilled in the art will 
recognize that the particular manner test pattern 510 is 

^^^j- a -! -o t-he invention. Once initiated, 
ir.ttiatec is r.Ov c 

viewer evaluates test pattern 510 to determine if display 
sc-e-r is 513 oositioned at an optical viewing angle to the 
viewer. One skilled in the art will recognize that the present 
invention is not limited to the evaluation of gray or 
luminance differences. Rather, the optimal display angle can 
be similarly determined by utilizing combinations of colors as 
test elements and patterns and adjustment can be made 
according to color changes or color differences between 
patterns. For illustrative purposes, however, the present 
"invention is described with respect to detecting the 
di-'erence in the levels of gray between the test elements and 
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I- particular, or.e set of test elements 512 has a 
luminance just beicw background 515 and the other set of test 
elements 514 has a iu-.nance just above background 515. To 
determine the cotimai viewing angle, a viewer evaluates test 
pa--.-, 510 to determine the difference in gray levels between 
test elements 512 and 514 against background 516. The viewer 
then adjusts the position of display screen 518 until test 
elements 512 and 514 either blend in with background 516 or 
provides the largest contrast with background 516, as 
discussed in detail below. Although the present -invention is 
described utilizing test elements 512 and 514 having different 
levels of gray, one skilled in the art will recognize that the 
Present invention may be implemented with as few as one patch 
havinc a luminance different from background 516. 

As noted above, in one aspect of the invention, the human 
visual system is used to detect differences in the color gray 
between elements 512 and 514 and background 516. Display 
sc-ee- 513 is tilted forwards or backwards relative to the 
user's viewing locat.cn -until test elements 512 and 514 blend 
in or provide the largest contrast with background 516. This 
blending or contrast is dependent on various factors, 
including the shape of the tone reproduction curve for the 
particular display. An exemplary curve for a flat panel 
display is illustrated in FIG. 22. Where a very low luminance 
(for instance 3/255 intensity) or a very high luminance (for 
instance 247/255 intensity) background 515 is utilized, the 
ootimal viewing angle is determined by adjusting display 
screen 518 until test elements 512 and 514 blend in with the 
background i.e.. have the same luminance as the gray shading 

30 in background 515. 

Where a -ediur. lur.ir.ance background =16 is utilized (tor 
instance 123/255 intensity), the optimal viewing angle is 
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determined when lower intensity test elements 512 (ror 
^ s , ance 0/155 intensity) and higher intensity test elements 
*!- .-*o- ^stance 255. 255 intensity) appear to provide the 
^gest contrast aga^st background 516 i.e.. have a luminance 
rraxirallv different from the gray shading in the background 
,16. The disolay screen 513 needs to be adjusted to make test 
elements 512 and 514 xost visible. Thus, for an optimal 
se — c the contrast between test elements 512 and 514 and 
background 516 is a, a maximum.. In accordance with the tone 
reproduction curve 52G shown in FIG. 22. what increases 
contrast at the mid-tor.es 522, decreases contrast m the 
darkest 524 and lightest areas 526. 

reactions or. display screen 518 inform the viewer to 
Really manipulate the viewing angle of the screen, either 
"horizontally, vertically or both, until the background 516 
looks uniform. This corresponds to the optimal relative 
position between user's eyes and flat panel surface. For 
"examole, in operatic, background 515 is made of an 8/255 
g ~av Elements are r^de of either 0/255 gray or 16/255 gray. 
Or- skilled in the ar: will recognize that these values have 
been chosen to work or. all color resolution systems, including 
but not limited to 3. 15/16 and 24/32 bit systems. Moreover, 
instead of adjusting the angle of the display screen 518, the 
viewer could adjust his or her viewing angle while leaving tne 
diaolay screen 51S stationary, use control mechanisms to move 
with display screen 515, use control mechanisms to adjust 
properties of the display that affect viewing angle or a 
combination of any of the above. 

Referring to FIG. 23. in accordance with another 

. „, , ho i... a -!.4 or present invention may also be 

embodiment c: the _..,e..--o.., t*— v- 

demented using tvc or more test patterns 530 and 532 
simultaneously in different portions of display screen 518. 
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in this configurator., the optimal viewing angle is determined 
bv adjusting display screen 518 until test elements 534 and 
535 in each test partem 530 and 532 blend in or maximally 
-ont-asts with its respective background 533 and 540. As 
noted above, whether the test elements 534 and 536 blend in or 
contrast with the background 538 and 540 is dependent on the 
shape of the tone reproduction curve 20 such as that shown in 
FIG*. 22 for the particular display screen 518. For example, as 
shown in FIG. 23, test pattern 530 includes elements 534 and 
535 displayed on low luminance background 538 while test 
oattem 532, disposed at the opposite end of display screen 
513, includes elements 535 and 537 displayed on high luminance 
background 543. Instructions on display screen 518 inform the 
viewer to tilt the screen 518, either horizontally, vertically 
or both, until the display screen 518 looks uniform (i.e. 
elements 534, 535, 535 and 537 disappear) or until elements 
534, 535, 535 and 537 provide maximum contrast against 
backgrounds 5 33 and 540. 

Referring to FIG. 24, in another embodiment of the 
invention, test patterns 542 and 544 for determining the 
optimal viewing angle of a flat display 513 are sequentially 
displayed in succession. In this configuration, the optimal 
viewing angle is determined by adjusting display screen 518 
until test elements 546 and 548 in each test pattern 542 and 
544 blend in or maximally contrasts with its respective 
background 550 and 552 after each test pattern 542 and 544 is 
displayed. The test patterns 542 and 544 sequentially 
displayed may be the same or different patterns. As noted 
above, whether the test elements 545 and 548 blend in or 
contrast with the respective background 550 and 552 is 
dependent upcr. the shape of the tone reproduction curve 520 as 
shown in FIG. 22 for the particular display screen 518. 
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Ins-uctions on display screen 518 inform the viewer to tilt 
the screen 513. either horizontally, vertically or both, until 
the display screen 513 looks uniform or the elements provide 

_ ~ rasoective background 550 and 

maximum contrast agai^- ^.ne^ .-s?ectii«- u * 

552. 

The present: inversion may be performed with or without 
human involvement and could be performed either locally or 
via a remoce device. Although the preferred embodiment 
iraplesier.es the test patterns as a method to adjust the 
viewing, sensing, and/or display angle of the device, these 
oattems could be just as easily used as part of a method to 
ore-orccess and/or otherwise alter images to be displayed on 
the device or to alter the display itself so that these images 
disolav, caoture, and/or print correctly after taking the tilt 
angle characteristics into consideration. In the case where 
sensing of luminance aad/or contrast of test elements is not 
limited to the human visual system, software implemented in a 
processor associated with the display screen can be used to 
defect the differences between the test elements and 
background and use such information to pre-process and/or 
otherwise alter images to be displayed on the device or to 
alter the display itself so that these images display, 
capture, and/or print correctly after taking the tilt angle 
characteristics into consideration. 

The present invention may be implemented as a computer 
program associated with a processor in communication with 
disolay screen. Referring to FIG. 25, a flow chart 540 of the 
ccmouter program for determining the optimal viewing angle of 
a display screen in accordance with the preferred embodiment 



o 
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-he invention is illustrated, 



In this particular 



embodiment . the optimal display angle for viewing the display 
screen is when the viewer's line of vision is perpendicular to 
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the surface of the display screen, i.e. at a 90 degree angle. 
In ether words, the viewer's line of vision is normal to the 
surface of the display screen. It. such case, the present 
invention initially generates a test pattern which is 
displayed on display screen as described earlier (step 542). 
The test pattern includes at least one indicator and a 
background, where the appearance of the indicator is different 
fror. the appearance of che background. The present invention 
then displays the test pattern on the display screen for 
viewing by the user (step 544). The present invention then 
generates instructions to the user to adjust the display until 
the indicators and background indicate that the display is at 
its optimal viewing angle (step 546) . As noted above, the 
optimal viewing angle may be achieved when the appearance of 
the indicators blend in with the appearance of the background 
after manipulation of the display. Depending on the 
particular pattern, the optimal viewing angle may also be 
achieved when the appearance of the indicator is maximally 
different from the appearance of the background after 
manipulation of the display. This manipulation as described 
above may be accomplished by physical rotation of the screen 
by the user or other means such as user controls and so forth. 

In accordance with an advantage of the present invention, 
the apparatus and method provides the ability to adjust the 
viewing, sensing, and/or display angle even where the optimal 
viewing angle of the display screen is not perpendicular (i.e. 
normal or at a 90 degree angle) to a viewer's line of vision. 
For example, where a particular display screen has an optimal 
viewing of 95 degrees, a user using the present invention car- 
determine the amount of rotation required to adjust the screen 
such that it is perpendicular (i.e. at a 90 degree angle) to a 
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user's line of vision using the method outlined in the 
flowchart' shewn ir. FIG. 25. The user can then consult 
manufacturer information regarding the particular display 
screen to determine the optimal viewing angle for the display 
and then calculate the difference between the screen's optimal 
viewing angle and 30 degrees. The user can then adjust the 
screen from the r.orr.al configuration (i.e. perpendicular 
angle) to the octir^al viewing angle. In the above example, 
the user would adjust the screen an additional 5 degrees from 
the normal angle (90 degrees) to obtain the optimal viewing 
angle for the user's particular display (95 degrees). In 
accordance with another embodiment of the invention, the 
optical display angle of known display screens can be 
preprogrammed in an d used by the software to determine the 
15 additional degree the display screen needs to be rotated from 
its normal configuration. 

In particular, FIG. 26 is a flow chart 547 of the 
computer program fcr determining the optimal viewing angle of 
a display screen ir. accordance with the an alternative 
embodiment cf the invention where the optimal viewing angle of 
the display screen is net 90 degrees. In such case, steps 
542, 544 and 546 shown in FIG. 25 are followed initially to 
rotate the display screen to a 90 angle (i.e. the angle 
between the user's line of sight and the surface of the 
display screen is 5C- degrees). In step 548, instructions are 
generated for a user to adjust the display an additional 
amount from the 90 degree viewing angle to achieve the optimal 
viewing angle for the display. The instructions may do this 
in a number of ways, including instructing the user to consult 
information regarding the particular optimal viewing angle of 
the particular display in question. The difference between 
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the optimal viewing angle and the 90 degree viewing angle is 
the additional amount the displayed must be rotated. 

IMAGE CAPTURE DEVICE CALIBRATION / CHARACTERIZATION 

In a still further aspect, the present invention provides 
a method and a system for determining the color biases of an 
image capture device, such as a digital camera, or a color 
scanner, using a color display of known color or spectral 
characteristics that can be used by an ordinary image capture 
device. user . 

In particular, the present invention may eliminate costly 
and fixed set of test colors by using a flexible color 
characterized/calibrated or spectral radiance calibrated 
disolay device for a color test pattern generation. One 
particular aspect of the present invention is the color 
characteristics of the image capture device can. be stored in a 
suitable forxat for use in a color management system or other 
device or system that can use or requires calibrated color 
image data or a characterized and calibrated device, which can 
be a valuable feature. 

This invention describes a method and a system for the 
color calibration of image capture devices, such as digital 
cameras, or color scanners, using a color display of known 
color or spectral characteristics. These color image capture 
devices may have as few as one channel, usually called black 
and white or monochrome system, or more than the usual three, 
"red", "green", and "blue* channels or signal paths. However, 
any number or choice of colors could be used in this 
invention. 

Referring to FIG. 27, a flow chart 6IC of a method for 
calibrating and characterizing an image capture device via a 
feedback ioc? from a known calibrated display is illustrated. 
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The present invention is implemented when a user 
calibrates/characterizes a display device to generate a 
calibrated display (step 612) of known coiorimetric 
characteristics. The present invention then displays at least 
one reference image cr. the calibrated display generating a 
calibrated reference image (step 614). The present invention 
then captures images from the imaging captured device to be 
calibrated (step 516.:. The present invention then compares 
the captured images cc each of the calibrated reference images 
(step 618) and a relationship is computed between the captured 
images and the calibrated reference images (step 620). The 
present invention then writes a profile describing the 
coioimetric characteristics of the device such that the 
profile can be used by a color management system to calibrate 
the image capture device (step 622) via a feedback or to 
correct images captured by the device. 

As noted above, in step 612.. the present invention 
calibrates or characterizes a display device to form a 
calibrated. display such that the spectral radiometric or 
coiorimetric properties are known. According to the present 
invention, the display is typically a variable display device. 
The display device can be any display device that can display 
an image. Further, this method is not limited to a display 
using only three colors, such as "red-, "green- or «blue« 
(RGB) that is typical of most displays. For example, this 
. method can be used with displays containing four or more 
primary colors, and for monochrome devices . According to 
another embodiment of the present invention, the display may 
also use a cathode ray tube, or a liquid crystal display, an 

_ .-or-; ot-\/ ^- o"he r disolav devices, 
emissive pane, cr ar.% ,ar.ety ~- ->- liC - - J 

— —-erred enfcodiment cf -his inventicn, a key 

feature of this display device is that it is not a static 
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reflective sample with color regions of known colorimetric 
properties, but rather a changeable imaging device of known 
colorimetric characteristics.- 

in one embodiment of the present invention, a method of 
calibration and characterization can be the measurement of the 
chromaticities of the display primaries and the input/output, 
or TRC. These are used in conjunction with a model of the 
display system t= calculate the spectral or colorimetric 
characteristics. Another method according to the present 
invention, is to display a number of colors with known RGB or 
other input values and build a multidimensional table relating 
the digital values driving the display to the display color 
characteristics. 

One skilled ir. the art will recognize that the display 
device can be coupled to a Central Processing Unit (CPU) such 
that any hardware and or software process can be used to 
perform the necessary calibration needed to calibrate the 
display device. In accordance with the present invention, a 
user may use any type of conventional or newly developed color 
calibration system including, for example, the interactive 
color calibration method disclosed in U.S. Patent No. 
5,633,117, or the self -calibrating display method disclosed in 
U.S. Patent No. 5,512.961. In the most preferred embodiment 
according to the present invention, the display device is a 
computer CRT and is calibrated using the aforementioned 

calibration methods. 

Referring to step 614, the present invention displays at 
least one reference image on the calibrated display generating 
a calibrated reference image. Generally, to calibrate the 
image capture device, a user displays a reference image or 
series cf images " the calibrated display device to create 
one or more calibrated reference images. These calibrated 
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reference images car. be written as a calibrated reference 
image profile whirr, car. be stored in memory and retrieved 
whenever this particular path is desired by the user, 
bypassing problems ar.d cost associated with printing a fixed 
reference color zest pattern, the latter which can be 
subjected to changes and deterioration over a period of time 
(for example, cclors fading due to light exposure, etc.) 

Preferablv. z'r.e reference image or images that are 
displayed or. the calibrated display are RGB and are redundant 
colors. In a preferred embodiment according to -the present 
invention, a sequence cf reference images are displayed, 
consisting of possible redundant colored areas. The reference 
images typically are sequentially of red, green, blue, white, 
and possibly other colors, each complecely filling the display 
area on the display device! According to the present 
invention, the calibrated reference image is a display of 
known colorimetric properties and can also be referred to as a 

color test pattern. 

However, image capture devices like cameras, for example, 
can often contain v;i.thin them automatic adjustment algorithms 
or processes which can adjust their image capture for the 
spectral quality and quantity of the illumination or 
irradiance on the scene or object. Those skilled in the art 
will recognize that there are processes to compensate for the 
correlated color temperature of the illumination, so the 
output or recorded three digital values representing the 
"white point" stand in a correct ratio. This white point 
adjustment process is analogous to the process of chromatic 
adaptation that is performed by the human visual system as it 
attempts to keep the appearance of "white objects" white. 
Also of importance are processes that dynamically or 
statically adapt, via a setting on the device, to the dynamic 
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or tonal range cf the scene or object to be imaged. These 
processes car. include the adjusting the input/output or TRC of 
the image capture device. According to the present invention, 
co account for these processes the displayed colors can vary 
in their absolute luminance or level of spectral radiance to 
simulate the varying levels of illumination under which the 
image capture device w-11 be used. The user must either 
compensate in the display device for the compensation 
algorithms in the image capture device, or the user must turn 
off the image compensation mechanisms in the image capture 

device, for example. 

Another consideration in step 614 is the selection of 
colors or spectral radiances in the reference images, which 
must be displayed so as to correctly simulate the light source 
illuminating the scene or object or areas being image 
captured. As a preferred embodiment for che array of color 
patterns or rest targets, the user would integrate, or 
average, to the chromaticity , tristimulus value, or correlated 
color temperature cf the simulated light source. According to 
those skilled in the art, this is similar to the so-called 
••gray world" assumption that is used as the basis of color 
balancing color photographic prints and "white point" 
balancing video cameras. According to the present invention, 
other criteria for establishing the overall properties of a 
set of test patterns (cf the reference images) to be displayed 
on the calibrated display device are possible and these would 
be guided by the overall objectives, goal, or usage of the 
color capture device. 

A preferred embodiment according to the present 
invention, in the consideration in the selection of reference 
images (color test patterns) is to select the number and 
locations cf colors, in color space, so there are a sufficient 
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number in regions of the capture device color space where 
there is large curvature of a high degree of nonlinearity. 
Often the calibrator, or characterization data from the image 
cacture device is used to build a multidimensional table for 
dezertr.ir.ing colcr values of the device. For example, if the 
color capture device has a high degree of nonlinearity more 
data or table points are needed for accurate conversion and 
therefore the spacing of the -.est target colors can be very 
critical . 

Yet another area is the spatial arrangement- of color on 
the display. Both displays and image capture devices have 
variation in their output and sensitivity, respectively. To 
minimize this variation both the spatial location of the test 
pattern on the display and the spatial location of the test 
"pattern imaged on the image capture device should be varied. 
Appropriate averaging of the recorded and stored data can be 
used to reduce these spatial nonuniform effects. 

According to the present invention, other considerations 
in displaying reference images, are ease of use, such as 
displaying test areas that are large enough to be easily 
captured by an imaging capture device, without requiring the 
user to precisely adjust the image area captured to the image 
area displayed on the display device. For example, when an 
end user to capture a snapshot of a full screen of red. green, 
and blue sequentially since there is often no requirement for 
precise alignment if full screens of colcr are displayed. 

Referring to the next portion of step 614. is to generate 
a calibrated reference image, or series of images, of the 
reference image (color test pattern) , displayed on the 
calibrated display. The reference image may be a single 

~ <r ^ a rrac =ooT*rr secr-ient Lai 1 v r ixed or 
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random order, which are captured by the image capture device 
in. one or mora capture steps. 

According, to the present invention, the calibrated 
display may be a distinct device from the image capture 
device, or for example, as in the case with many digital 
cameras, it may be a display built into the image capture 
device itself. In the latter case, the calibrated display 
would be folded over, or moved, or adjusted so that the camera 
can capture an image of its own display. - In other words, the 
user would just sr.ap pictures of each of the reference images 
in random or specific sequence. This step may also involve 
the use of a color or other optical filter placed over the 
face of the calibrated display or over the "lens" of the image 

capture device. 

Referring to step 616, the present invention then 
captures images from the imaging captured device to be 
calibrated. In other words, capture the calibrated reference 
image displayed as described in above instep 614 on the image 
capture devices' light sensitive elements. For an image 
capture device such as a camera, the device can be positioned 
or pointed at the display and an image of the color test 
patterns, within the test target, or including the test target 
and a known or unknown surround, and such reference patterns 
are imaged on the image capture surface of the device. 
Another possible method for a flat bed scanner would be to 
place, for example, an LCD or any other so-called flat panel 
display device, on the scanner plate or bed and "scan- the 
image on the calibrated display; The captured digital image 
data from each of the color areas of the test pattern can be 
stored in a device, for example, such as a computer for later 
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Referring now tc step 618, compare the captured images to 
each of the calibrated reference images. Data from the 
captured images are compared to data from the calibrated 
reference images fcr colors that the user desires. 

As noted in step 520, a relationship is computed between 
the coiorimetry of the captured images and the colorimetry of 
the calibrated reference images to generate a data file that 
describes the colorimetry of said image capture device. In 
other words, a relationship is made between the captured 
images red., green and blue digital values with the known 
colors displayed on the calibrated reference images and a 
correction profile for the image capture device is generated. 
This relationship is not limited to the red, green and blue 
channel or digital values. It can be more than three colors 
or "channels," including a full description of the spectral 
properties such as radiance, reflectance, or irradiance. 

Referring to step 522, a profile describing the 
colorimetric characteristics of the device is written such 
that the profile (a data file or other form of description 
describing the relationship) can calibrate the image capture 
device via a feedback mechanism. Preferably, the profile is 
written describing differences in images captured attributable 
to the characteristics of the image capture device. 

Typically, this means that the final step is to take from 
the correction image, the stored digital data for each color 
area and use it to create a characterization or calibration 
profile for later use. For example, a user may use any type 
of conventional or newly developed characterization or 
calibration profile method including," for example, the 
characterization or calibration profile disclosed in U.S. 
Patent Mo. 5.561.455. In the most preferred embodiment 
according to the present invention, the profile of the image 
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capture device from s:e? 22, is stored in the International 
Color Consortia. (ICC: specification, although any format: that 
meets the conditions according to the present invention, may 
be used. ICC profiles are device profiles that can be used to 
translate color data created on one device into a native color 
space of another device. These ICC profiles for the device 
characteristics may be embedded in an image file or stored in 
a memory in a connected personal computer. For example, the 
ICC orofiles could be stored in a memory- accessible by a CPU . 
In an attempt to identify color corrected images, conventional 
images are color tagged with information, often in an 
International Color Consortium PICC) color profile format, 
before posting on a compact disc, web site, or other 
repository fcr later viewing, as is well known in the industry 
and defined by the ICC Profile Format Specification, ICC 
1:1993-09 and addenda, the contents of which are hereby 
incorporated by reference (latest version available at 
http://ww.cclor.org). Further, the calibration or 
characterisation profile can be in the form of a 
multidimensional look-up table (LUT) or perhaps a more 
simplified data that assumes some imaging model for the image 

capture device. 

Once the initial calibration has occurred, a user can 
recalibrate the image capture device which can be easily 
implemented by regenerating the profile and comparing it to 
the calibrated reference images which were originally 
calculated and stored in the calibration memory. 

Referring now to FIG . 28, a functional block diagram of a 
calibration system 64C for image capturing devices is 
illustrated. Calibration system 640 is shown with image 
capture device 642, display device 644 and a transmit path 
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in operation, ar. end user uses the display device 644 to 
calibrate ar. image capture device 542. The display device 644 
is -voicaliv a variable display device that car. display an 
imace. in a preferred embodiment , the display device can be 
calibrated/characterized to display colors with known 
coicrimetric properties (CIS trisimulus values) . This 
calibration/characterization is preferably in the form of a 
profile. The standard format for the profile is the ICC. The 
profile preferably is cclorimetric . 

•The display device 644 can be coupled to a Central 
Processing Unit (CPU) , and can contain a memory. Peripheral 
devices of display device 644 includes terminals, data storage 
devices, printers. The display device 644 can be coupled to a 
conventional computer system which includes hardware and/or 
software components. According to the present invention, the 
computer can control the display device to generate a 
colcrimetricaily calibrated/characterized display, by using 
various software application programs which car. operate to 
calibrate the display device. These software application 
programs are well known in the art and are described above. 
?z least one reference image can be displayed on the 
calibrated display generating a calibrated reference image 
with known colorirr.etric properties. 

According to the present invention, the sys.tem includes a 
transmit path 64c between image capture device 642 and display 
device 644. The transmit path 646 can also function as a 
feedback loop which, according to the present invention, can 
be used as a link to transfer images between the display 
device 644 and image capture device 542 resulting in a 
calibrated image capture device 642. 

The image capture device 642 car. be any image capture 
device that can be calibrated and known to those skilled in 
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the art including scanners, monitors, printers, televisions or 
digital cameras. The image capture device 642 typically 
caotures images and via the transmit path 646. transfers the 
captured images to the displayed device 644. The captured 
images and the known colorimetric properties of the calibrated 
reference images are compared and a relationship between the 
captured images and the calibrated images is computed. Next a 
profile is written describing colorimetric characteristics of 
the image capture device according to the relationship, which 
can be transmitted via the transmit path 646, from the now 
calibrated display device 644 to calibrate the image capture 
device 642 . 

The present invention- includes a number of features and 
advantages. First, the present invention provides a simple 
method and system for calibrating and characterizing an image 
capture device using a calibrated display of known 
colorimetric properties. The calibration features of the 
present invention require little user intervention. Further, 
distortions introduced by elements typically seen in 
calibration methods are reduced. For example, distortions 
introduced by having a fixed calibrated image that can fade or 
distort colors over time due to exposure to light or wear and 
tear, are eliminated by using the flexible colorimetric system 
according to the present invention. Further, many of the 
distortions that depend on fixed calibrations are often time- 
varying and are often unable to compensate for drift over 
time. The present invention permits the user to compensate for 
these time-varying problems. Still further, typically an 
application will print a saved image in one file format 
differently from the same image in a different file format. 
^ a ™ S er.t invention keeps track of the file format that was 
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used for the calibration images by encoding them in a suitable 
orofile format chat are created from those calibration images. 

Having now described the invention in accordance with the 
requirements of zhe patent statutes, those skilled in this art 
will understand how to make changes and modifications in the 
present invention to meet their specific requirements or 
conditions. Such changes and modifications may be made 
without departing from the scope and spirit of the invention 
as set forth in the following claims. 
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We claim: 



1. A mechod cf providing one or more images to a user 
comprising the seeps of: 

determining available user display characterization data; 

and 

sending one or more images to the user according to the 
user display characterization data. 

2. The method of claim 1 further comprising the step of: 
displaying an icon to a user according to the display 

characterization data, 

3. The mechod cf claim 2 wherein the step of displaying an 
icon to a user according to the display characterization data 
further comprises : 

displaying a first icon to a user having display 

characterization data. 

4. The mechod cf claim 2 wherein the step of displaying an 
icon to a user according to the display characterization data 
further comprises : 

displaying a second icon to a user having no display 

characterization data. 

5. The method of claim 1 wherein the step of sending one or 
more images to the user according to the user display 
characterization data further comprises: 

color correcting the one or more images on- the- fly. 

5. The method cf claim 1 wherein the step of sending one or 
more images zo the user according to the user display 
characterization data further comprises: 
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selecting the one or rr.ore images from one or more groups 
of pre- trans formed images. 

7. The method of claim 1 wherein the step of sending one or 
more images to the user according to the user display 
characterization data further comprises: 

color correcting -he one or more images according to tne 
user display characterization data. 
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